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Abstract — A multivariate biorthogonal wavelet system can be 
obtained from a pair of biorthogonal multivariate refinement 
masks in Multiresolution Analysis setup. Some multivariate 
refinement masks may be decomposed into lower dimensional 
refinement masks. Although tensor product is a popular way 
to construct a decomposable multivariate refinement mask from 
lower dimensional refinement masks, it may not be the only 
method that can achieve this. 

We present an alternative method, which we call coset sum, 
for constructing multivariate refinement masks from univariate 
refinement masks. The coset sum shares many essential features 
of the tensor product that make it attractive in practice: (1) it 
preserves the biorthogonality of univariate refinement masks, (2) 
it preserves the accuracy number of the univariate refinement 
mask, and (3) the wavelet system associated with it has fast 
algorithms for computing and inverting the wavelet coefficients. 
The coset sum can even provide a wavelet system with faster 
algorithms in certain cases than the tensor product. These 
features of the coset sum suggest that it is worthwhile to develop 
and practice alternative methods to the tensor product for 
constructing multivariate wavelet systems. 

Index Terms — Coset sum, fast algorithm, interpolatory mask, 
refinement mask, tensor product, wavelet mask, wavelet system. 



I. Introduction 

One of the most common tools for constructing wavelets is 
Multiresolution Analysis (MRA) |[I]. In MRA, a biorthogonal 
multivariate wavelet system can be obtained from a pair 
of biorthogonal multivariate refinement masks. The tensor 
product has been the prevailing method for deriving a pair 
of biorthogonal multivariate refinement masks from a pair of 
biorthogonal univariate refinement masks. 

Throughout this paper, we refer to any of the functions 
involved in wavelet construction (i.e. mother wavelets, wavelet 
masks, refinable functions, and refinement masks) as a wavelet 
function. We also refer to an operator that maps lower dimen- 
sional wavelet functions to higher dimensional wavelet func- 
tions as liftable. The multi-D wavelet functions that are ob- 
tained by the liftable method are referred to as decomposable. 
The multi-D wavelet functions obtained via tensor product are 
called tensor product (or separable) wavelet functions. Since 
the word "separable" is reserved for the tensor product by the 
definition in the literature, we use the word "decomposable" to 
indicate more general case than the tensor product. It should 
be noted that a "nonseparable" wavelet function only means 
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it is not a tensor product wavelet function, and it can still be 
a "decomposable" wavelet function. 

In MRA setup, construction of multi-D biorthogonal 
wavelet systems can be done by two steps: (i) construction 
of multi-D biorthogonal refinement masks (or refinable func- 
tions); (ii) construction of multi-D wavelet masks. To construct 
a nonseparable multi-D wavelet system, one can try making 
the refinement masks nonseparable in step (i) or making 
wavelet masks nonseparable in step (ii). Since, once a pair 
of multivariate biorthogonal refinement masks are given, the 
matrix extension problem of finding wavelet masks can always 
be solved by using Quillen-Suslin theorem (see, for example, 
|2|), the main effort so far for constructing nonseparable 
wavelets has been made in step (i). 

Although there have been many methods for constructing 
nonseparable multi-D wavelets |3|-|16|, constructing nonsep- 
arable multi-D wavelet systems is highly nontrivial. Many of 
these methods work only for low spatial dimensions (2-D or 
3-D) and they cannot be easily extended to other dimensions. 
Others assume that the wavelets or refinable functions have 
a special form (e.g. the refinable function has a box spline 
factor) and cannot be easily generalized to other cases. 

We now make a couple of comments regarding the typical 
approach of constructing MRA-based multi-D biorthogonal 
wavelet systems mentioned earlier First, although there have 
been many attempts to address the step (i), no liftable method 
that preserves the biorthogonality of the refinement masks has 
yet been reported other than the tensor product, to the authors' 
best knowledge. Second, Quillen-Suslin theorem serves only 
as a guide since in the process of determining the wavelet 
masks, some parameters still need to be specified. 

Most multi-D wavelet systems that are used in practice 
nowadays are separable wavelet systems constructed by the 
tensor product of 1-D wavelet systems. In i jll-BI we briefly 
discuss the use of tensor product in constructing biorthogonal 
wavelet systems. As we can see from there, the tensor product 
construction of wavelet systems is extremely simple. This 
is one of the major reasons the tensor product has been so 
popular in constructing multi-D wavelets in practice. However 
the separable wavelet systems have limitations: (i) they have a 
strong directional bias along lines parallel to the coordinate 
direction, (ii) they are not very local', (iii) the associated 
computational algorithms are not fast enough. Let us elaborate 
on (iii). For the tensor product wavelet system with k vanishing 

' One way to measure the localness of a wavelet system is to compute the 
sum of the volumes of the supports of its mother wavelets (cf. 1171 . 1181 ). 
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TABLE I 

Comparison between tensor product and coset sum (n > 2) 



Tensor product l~n (R, R- univariate refinement masks) 


Coset sum C„ (R, R: univariate refinement masks; R: interpolatory) 


Tn [R\ can be decomposed into the product of R 


Cn [R^ can be decomposed into the sum of R 


' 1 /V -f c "Tnl"fi"mr\l nfr^n? t tt §-< i c i fifj^tT^ol ntriT^/ 
/ 71, 1 -I L is illlCl UUlcllUl y 111 J I, la llllClLUJltlUJi y 


i ht\ ic int"f^mnl nff^t^/ itt ti ic infrfm^^l sifr^n/ 
L'Ti -I t IS llllCl UOldlOiy lii J I, la llllCiU^^ltllUi V 


Tn [i?] and Tn [R\ are biorthogonal iff _R and R are biorthogonal 


Cn [^?] and Cn [R] are biorthogonal iff R and R are biorthogonal 


Tn [F!\ and R have the same accuracy number 


Cn [R] and R have the same accuracy number 


Tn [P!\ can be decomposed into nonunivariate refinement masks 


Cn [^?] can be decomposed only into univariate refinement masks 


Complexity constant in associated wavelet algorithm increases with n 


Complexity constant in associated wavelet algoiithm is independent of n 



moments (e.g. Daubechies wavelet system of order fc fT9|), 
the associated algorithm has complexity CknN (cf. §II-BI and 
Eoi ). where n is the spatial dimension, N is the size of an 
initial data to be analyzed, and C is a constant independent of 
k, n, and N. Thus, the constant in the complexity bound (cf. 
Complexity discussion in i ^IV-Bl for the definition) in this case 
is Ckn and it grows linearly with the spatial dimension. This 
is not desirable for high spatial dimensions (i.e. for large n), 
since typically the size of dataset N increases as n increases 
and one wants to make the complexity constant as small as 
possible. We show in ijlV-BI in certain cases, this can be 
improved by using an alternative method to the tensor product. 

Our goal in this paper is to present an alternative method 
to the tensor product for constructing decomposable multi-D 
refinement masks. We call the new method as coset sum. We 
show that, under an appropriate circumstance, the coset sum 
shares many attractive features of the tensor product. First, it 
preserves the biorthogonaUty of univariate refinement masks. 
Second, it preserves the accuracy number of the univariate 
refinement mask. Third, it has a corresponding wavelet system 
which has fast algorithms for computing and inverting the 
wavelet coefficients. In fact, it turns out that these algorithms 
are faster, in certain cases, than the known algorithms based 
on tensor product wavelet systems (cf. Example 6). The main 
difference between the two methods is that a "sum" is used 
in obtaining the coset sum multi-D refinement masks instead 
of a "product" used in the tensor product refinement masks. 
Another difference is that, on the contrary to the tensor product 
case, the coset sum refinement mask cannot be decomposed 
into non-univariate refinement masks. Table |I] summarizes the 
comparison between the tensor product and the coset sum. 

The rest of the paper is organized as follows. In f|ll] we 
briefly overview some relevant concepts on wavelet construc- 
tion. In S|III]we introduce the coset sum method and discuss 
its properties. In ijlVl we present the wavelet system associated 
with the coset sum, together with its fast algorithms. We 
summarize our results and present some observations in S|V] 
All the proofs of the theorems in this paper are included in 
the Appendix. 

II. Preliminaries 
In this section we review some relevant concepts. 



A. Refinement masks and wavelet masks 

In this paper we refer to a Laurent trigonometric polynomial 
as a mask, and a mask r with t(0) = 1 as a refinement mask. 
Refinement masks can be used to obtain refinable functions 
(see, for example, f2T|), which can in turn be used to construct 
wavelet systems 

Refinement masks r and r"^ are biorthogonal if they satisfy 
the following biorthogonal relation: 

^(rT'i)(w + 7) = l, Vu;eT":=[-7r,^]", (1) 
7eTrr 

where F := {0, 1}" and the overline is used to denote the 
complex conjugate. 

A refinement mask r is interpolatory if the condition 

^ t(cj + 7) = 1 
7eirr 

holds. Thus refinement masks t and r"* are biorthogonal if and 
only if tt'^ is interpolatory. Interpolatory masks are widely 
used in subdivision schemes and wavelet constructions (for 
example, see (221 and references therein). 

In this paper we say that a filter : Z" — > M is associated 
with a mask r if ft, and r are connected via the relation r(a;) = 
z^EfeeZ" foro^GT". 

It is straightforward to see that r is interpolatory if and only 
if the associated filter h satisfies 

^''^^ = { oi if fc e 2Z"\0, 

to which we refer as the interpolatory condition for the filter 
For a refinement mask r, the number of zeros of t at 
7 e ttT' with r' := r\0 = {0, 1}"\0 is referred to as the 
accuracy number ll23l . Throughout the paper we assume that 
all refinement masks have at least one accuracy number, since 
almost all of the refinement masks used in practice satisfy this 
condition. 

We recall that the Laurant polynomials {tj,tj : j = 
1, - ■ ■ ,1} are called the wavelet masks associated with a pair 
of biorthogonal refinement masks (r, r^) if they satisfy the 
Mixed Unitary Extension Principle (MUEP) conditions f24\ : 
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for every a; € T", 



(3) 

When 1 — 2^—1, the masks that satisfy the MUEP conditions 
can be used to construct biorthogonal wavelet systems. We 
refer to such (r, (ij)j=i^...^2"-i) and (r'^, (t^)j=i^...^2"-i) as 
the combined biorthogonal masks. A (MRA-based) biorthog- 
onal wavelet system is then obtained from these combined 
biorthogonal masks, under some simple additional conditions 
L25J, L26J. 

For a wavelet mask t, the number of zeros of t at cj = 
is referred to as the number of (discrete) vanishing mo- 
ments 1271 . It is well-known (see, for example, 1271 ) that 
for the combined biorthogonal masks (r, ... 2'«-i) and 

(t"^, (<j')j=i,...,2"-i) whose refinement masks have at least m 
accuracy, every wavelet mask tj and the dual wavelet mask 
fj, i = 1, • • • ,2" — 1, has at least m vanishing moments. 
The number of vanishing moments is closely related to the 
approximation performance of the wavelet system |28J. 



B. Tensor product wavelet construction 

We recall that the n-D tensor product (or separable) re- 
finement mask from n (possibly distinct) univariate refine- 
ment masks Ri, R2, ■ ■ ■ , Rn can be written as, for ui = 

(wi,W2, • • • ,w„) e T", 

r„[i?i, i?2, • • • , := Ri{uJi)R2{uj2) ■ ■ ■ i?„K). (4) 

When R = Ri = R2 = ■ ■ ■ = Rn, we use the notation %i[R]- 
If we let H and h be the filters associated with the masks R 
and 7^[i?] respectively, they satisfy, for fc = (fci, fc2, • • • , fc„) e 
Z", 

h{k)=H{ki)H{k2)---H{kn). 

It is well known that the n-D refinement masks constructed 
using tensor product preserve many useful properties of uni- 
variate refinement masks. For example, if we let R and R be 
univariate refinement masks, then 

(i) Tn [R] is interpolatory if and only if R is interpolatory, 

(ii) Tn[R] and Tn[R] are biorthogonal if and only if R and 
R are biorthogonal, 

(iii) Tn [R] and R have the same accuracy number. 

Now we pose the following question. Can we find another 
liftable method that satisfies all of the above properties? An 
affirmative answer is provided by the coset sum, which we 
introduce and study in the next section. Before introducing the 
coset sum, let us review the usual approach for constructing 
biorthogonal wavelet systems. 

Construction of 1-D biorthogonal wavelet systems is well- 
understood. Given a pair of 1-D biorthogonal refinement 
masks 6*0 and Uq, one sets the wavelet masks as 



:= e-'^Uoiuj + n), C/i(w) := e-'^'Soiuj + n) (5) 

for w e T. Then the univariate pairs (5*0,51) and {Uo,Ui) 
satisfy the MUEP conditions (cf. O}) 1251 . 



On the other hand, given a pair of multivariate biorthogonal 
refinement masks, constructing a multivariate biorthogonal 
wavelet system is not so trivial since one needs to find 2" — 1 
wavelet masks tj's and 2" — 1 dual wavelet masks tj's. 

The usual construction of multi-D biorthogonal wavelet 
systems is done by the tensor product. Given a pair of 1-D 
biorthogonal refinement masks 5o and Uq, one sets the n-D 
refinement masks as 



r:=r„[5o], r° 
and the n-D wavelet masks as 



Tn[Uo] 



for all V = {vi,i'2, - ■ ■ iVn) e T'. Then (t, (ty)yer') and 
{'r'^Att)i'er') satisfy the MUEP conditions (cf. Q). Here 
r' = {0, 1}"\0 is used as before, and the univariate masks 5*1 
and Ui are the ones defined in (|5]l. The biorthogonal wavelet 
systems obtained from these masks are the tensor product (or 
separable) wavelet systems. 

It is well-known that tensor product wavelet systems have 
fast algorithms for computing and inverting wavelet coeffi- 
cients (see, for example, l20l ). to which we refer as the 
fast tensor product wavelet algorithms. These algorithms have 
linear complexity 0{N), where N is the size of the input 
data. More precisely, if a is the number of nonzero entries of 
the filter associated with 5*0 and /3 is the number of nonzero 
entries of the filter associated with Uq, then the algorithms 
for computing and inverting the corresponding tensor product 
wavelet coefficients have complexity (a + f3)nN, where n 
is the spatial dimension. In particular, the constant in the 
complexity bound is (a + /3)n and it increases as the spatial 
dimension increases. 

III. Coset sum 
A. Introduction to coset sum 

We present an alternative method, called coset sum, to 
the tensor product in wavelet construction. Instead of the 
"product" in the tensor product, we propose to use a "sum" 
to construct multivariate refinement masks from univariate 
refinement masks. 

Let i? be a univariate refinement mask and let H be the 
univariate filter associated with R. For v V — r\0 = 
{0, 1}"\0, the map 

T" ^ C : w -^Riuj ■ v), 

2r! — 1 ^ " 

where lo ■ v \s the inner product in R", is an n-D Laurent 
trigonometric polynomial. The normalization factor is 
used to place • v) in the n-D space. In terms of filters, 
the above can be understood as aligning the 1-D filter H along 
the V direction: 



k i-> 



H{K), if fc = iCi^ for some /v e Z 
0, otherwise 



Since we want to consider all the directions in F', a possible 
candidate for the coset sum definition can be given as 

T" ^C:oj^ A+ -i-- V R{uj ■ v). 
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Since we want the coset sum to map a 1-D refinement mask 
to an n-D refinement mask, by plugging m lo — 0, we obtain 
A = — 1 + 2TrW and get to the following definition. 

Definition 1: We define the coset sum C„ that maps a 1- 
D refinement mask R to an n-D refinement mask C„[i?] as 
follows: for w e T" 

Cn[R]{^) ^ - 2"-' + E • ' 

where V = T\Q = {0, 1}"\0. ■ 

Remark. We call the refinement mask obtained by the coset 
sum method as the coset sum refinement mask. The set 
r = {0, 1}" used in the definition is a complete set of 
representatives of the distinct cosets (hence the name "coset 
sum") of the quotient group Z"/2Z". Since the mask R is 2-k- 
periodic, the set {0, 1}" can be replaced by any other complete 
set of representatives of the distinct cosets of the quotient 
group Z"/2Z". The set {0, 1}" is chosen for the discussion in 
this paper (with the exception of Example 3) because it makes 
the support of the associated filter the smallest. Depending on 
applications, choosing a different set of representatives can 
make more sense. ■ 

We note that the coset sum formula in the above definition 
can be simplified as 



(6) 



The coset sum for the first few low dimensions are given as 
follows: 

Ci[i?]H = i?H, 

C2[i?](cJi,CJ2) = i{-l+i?(t^l)+i?(cj2)+-RK+W2)}, 



C3[i?](wi,W2,W3) = -{-3 + i?(wi) + i?(a;2) + i?(wi+W2) 
+R{ijJz) + R{loi + W3) + R{i02 + ^3) + + ^2 + wa)}. 

The filter h associated with the coset sum refinement mask 
Cn[R] is connected to the univariate filter H via 

( H{K), ifk^Kv for some K e Z\0, v e F, 
h{k) = <^ 2" - (2" - 1)(2 - i/(0)), if = 0, 
[ 0, for all other fc € Z". 

If the univariate mask R (and the corresponding univariate 
filter H) is interpolatory, the n-D coset sum refinement mask 
is also interpolatory and it can be written as 

C"[^] = ^(^+E (^(-•-)-^)), (7) 

and the associated filter can be expressed as 

h(k\ - / ^(-^^')' '^^k = Kv for some K (^Z.v V , 
^ ~ 1 0, for all other k e Z". 

(8) 

In particular, the restriction of the n-D filter h to v direction, 
for each v e V , is the 1-D filter H. 



1 1 
^ 1 1 

(a) 2-D Haar by tensor product 
1 1 

1 1 m 1 

(b) 2-D Haar by coset sum 
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Fig. 1. Constructions of 2-D Haar refinement filter (Tensor product and 
Coset sum) (cf. Example 1) 



Now we give a few very simple examples of constructing 
multi-D refinement filters from univariate refinement filters. 

Example 1: n-D Haar refinement filter: the only filter that 
can be obtained using either the tensor product or the 
coset sum. Consider the 2-D Haar refinement filter 



h{k) 



1, if fc = (0,0), (1,0), (0,1) or (1,1), 
0, otherwise. 



Let H be the 1-D Haar refinement filter 

1, \f K = idov K ^l. 



H{K) 



0, otherwise. 



Then h can be obtained from H either by 

(I) (Tensor Product Case) aligning the filter H along y = 

line (a;-axis) and y = 1 line (see Figure^ Ufa)), or by 
(II) (Coset Sum Case) aligning the filter H along y — Q 
line (a;-axis), x = line (y-axis), and y = x line (see 
Figure Eb)). 

Since the support of the 2-D tensor product refinement filter 
will always be a square and the support of the 2-D coset 
sum refinement filter will always be the union of three line 
segments in different directions, it is easy to see that, up to the 
integer translation, the 2-D Haar refinement filter is the only 2- 
D filter that can be obtained using either the tensor product or 
the coset sum. It is straightforward to show that, for arbitrary 
spatial dimension n, the n-D Haar refinement filter the only 
filter that can be obtained using either the tensor product or 
the coset sum. ■ 

Example 2: Refinement filter associated with an n-D 
piecewise-Unear box spUne. Let us consider the 2-D refine- 
ment filter h associated with a 2-D piecewise-hnear box spUne 



h{k) 



if fc = (0,0), 

if fc = ±(l,0), ±(0,1), or ±(1,1), 
otherwise. 



Let H be the refinement filter associated with a 1-D piecewise- 
linear spline: 

rl, if K^O, 
H{K) = < 5, if -ft: = ±1, 
I 0, otherwise. 

Then h can be obtained from H by aligning the filter H along 
y = Q line (x-axis), x = line (y-axis), and y — x line (see 
Figure |2]l. In other words, h — C2[H]. In fact, it is easy to see 

-In the figures of filters drawn in this paper, the bold-faced number is used 
to represent the value of the filter at the origin. 
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Fig. 2. Construction of 2-D piecewise-linear box spline refinement filter 
(Coset sum) (cf. Example 2) 
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Fig. 3. 2-D coset sum refinement filter supported on different directed line 
segments (cf. Example 3) 



that for the n-D refinement fiher h associated with an n-D 
piecewise-linear box spline, we have h = C„[H]. ■ 

Example 3: Refinement filter supported on different di- 
rected line segments. We consider n ~ 2 and choose the 
same univariate filter R as in Example 2, but choose the 2-D 
filter h differently: 



h{k) 



if A: = (0,0), 

if /fc = ±(1,2), ±(2,1), or ±( 
otherwise. 



4,1) 



Then h — C2 [H] with F chosen differently (cf. Remark after 
Definition [U: 

r = {(0,0),(2,l),(l,2),(-l,l)}. 

In particular, h can be obtained from H aligning the filter 
H along y = x/2 line, y — 2x line, and y = —x line 
(see Figure O. Note that the filter h is supported on the line 
segments that are not parallel to the coordinate directions. ■ 



B. Properties of coset sum refinement masks 

In this subsection, we study the properties of the multi-D 
refinement masks obtained by the coset sum method. 

The following theorem shows that the refinement masks 
obtained by the coset sum share many important properties 
with the tensor product refinement masks. 

Theorem 1: Let C„ be the coset sum, and let R and R be 
univariate refinement masks. 

(a) Cn[R] is interpolatory if and only if R is interpolatory. 

(b) Suppose that one of R and R is interpolatory. Then [R] 
and Cri[^] are biorthogonal if and only if R and R are 
biorthogonal. 

(c) Suppose that R is interpolatory. Then C„ [R\ and R have 
the same accuracy number. 

Proof: See Appendix lAl ■ 

Below we add a few remarks on Theorem [T] 

Remark on Theorem[TIb). The interpolatory condition in part 
(b) cannot be omitted. To see this, we consider the univariate 
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Filter associated with 

C2 (Coset sum) 
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Filter associated with C2[C/4] 

Fig. 4. Refinement filters associated with the masks Ua and C2 [C/4] in 
Example 4 



refinement mask associated with Daubechies wavelet system 
of order 2 1 19 1, and let 

i + Vs 1-73 _/ 



R{uj) = R{uj) = cos^(-) 



.uj eT. 



Then R (hence R) is not interpolatory, and R and R are 
biorthogonal. However it is easy to see that C2[R] and C2[i?] 
are not biorthogonal. ■ 

Remark on Theorem [TJc). For general (not necessarily 
interpolatory) R, the accuracy number of C„[i?] is at least 
min{mi, 7712} where mi is the accuracy number of R and TO2 
is the order that 1 — i? has a zero at the origin. This statement 
can be proved using arguments in the proof of Theorem [He), 
and we omit the proof. ■ 

The Deslauriers-Dubuc mask |30| of order 2k (k E N) is 
defined as 



Pk{x): 



,,2k 



(9) 



fe-i 



(fc-l + j)! 



The mask U2k is interpolatory and has accuracy number 2k. 
We now present a family of biorthogonal coset sum refinement 
masks based on the Deslariers-Dubuc interpolatory masks. 

Example 4: A family of n-D biorthogonal coset sum 
refinement masks. For each fc G N, we choose U2k in (|9]i as a 
univariate interpolatory refinement mask. By Theorem[Tla)(c), 
Cn [U2k] is an n-D interpolatory refinement mask with accuracy 
number 2k. It is straightforward to see that for each k E N, 

^2fc :=C/2fc(3-2C/2fc) (10) 

is biorthogonal^ to U2k - By TheoremlTJb), Cn[U2k] is biorthog- 
onal to Cn[S2k] - Since S2k has at least 2k accuracy and 1 — S'2fc 
has a zero of order at least 2k at the origin, by the Remark 
on TheoremfHc), Cn[S'2fc] has at least 2k accuracy. The filters 
for the cases = n = 2 are depicted in Figure |4] and |5] ■ 

^ Given a refinement filter, a dual refinement filter is not uniquely determined 
in general. The specific choice of the dual filter of U2k as in ilO\ was obtained 
after scrutinizing a result (Theorem 2) of 131]. 



Filter associated with 6*4 

C2 (Coset sum) 
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Filter associated with C2[S'4] 



Fig. 5. Refinement filters associated with the masks 54 and C2[S4\ in 
Example 4 

Similar to the tensor product case, the coset sum can 
actually take different univariate refinement masks. However, 
since the cardinality of the set F' is 2" — 1, we have 2" — 1 
different directions to consider, instead of n different coordi- 
nate directions for the tensor product case. In such a case the 
n-D coset sum refinement can be written as 

C„[(i?.).er'](w) ■■=^i{^- 2""' + E ^-(^ • '^)) ' 

(11) 

where R^, v e F', are possibly distinct univariate refinement 
masks for different direction v. 

Let n = ni + rt2 + • • • + "-m, nj > 1 for j = 1, 2, • • • , m. 
Then the tensor product refinement mask in (|4]i can be 
written as the product of possibly non-univariate lower di- 
mensional tensor product refinement masks as follows: for 

r„[i?i,---,i?„]H 

= Tni [Rl, ■ ■ ■ , ^niK'^l, • • • ,<^rii) ' 

Tn2 [-Rrii + l I ' ' ' : -Rrii +"2 ] ('^"l +1 J ' ' ' i ^ni+n2 ) 
■ ■ ■ ^71^ [-RniH hri„_i+l, • ■ ■ , Rn]{l^niA hTi„„i+l, ' ' ' , ^n)- 

On the contrary, the coset sum refinement mask cannot be 
written as the sum of non-univariate lower dimensional coset 
sum refinement masks. 

We can also consider a hybrid of the coset sum and the 
tensor product : for n = ni + n2 + ■ ■ ■ + n„i,nj > l,j = 
l,2,---,m, 

■ ■ ■ [R]{^ni-\ hnm-i + li • • • I ^n)- (12) 

Similar statements to the ones of Theorem [T] can be made for 
the coset sum refinement mask in a generalized sense as in 
(fTTT i and for the hybrid refinement mask as in ( fT2] i. We omit 
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Fig. 6. The tensor product multivariate refinement masks are not the only 
decomposable refinement masks. The coset sum provides a systematic way 
to construct other types of decomposable refinement masks. The multivariate 
Haar refinement mask is essentially the only mask that can be obtained by 
using either the tensor product or the coset sum (cf. Example 1). 



the statements and the proofs as they are similar to the ones 
of Theorem [T] 

The diagram in Figure |6] illustrates the relation among the 
tensor product, the coset sum, and the decomposable multi-D 
refinement masks. 

IV. Application: coset sum wavelet systems 

In this section we introduce a special class of wavelet 
systems that can be derived from coset sum refinement masks 
in a very simple manner, and study their fast algorithms. 

A. Coset sum wavelet systems 

Since the coset sum provides a way to construct a pair of 
biorthogonal multivariate refinement masks from univariate 
ones, it can be combined with any procedure for finding 
wavelet masks to construct a biorthogonal multivariate wavelet 
system. Below we present a procedure that stands out in terms 
of simplicity of the construction. 

Suppose that S and U are 1-D biorthogonal refinement 
masks, and that U is interpolatory. Theorem [TJb) implies that 
the 71-D coset sum refinement masks C„[5] and C„[?7] are 
biorthogonal. Moreover, since U is interpolatory, from Q 
and ([8]) we see that the restriction of the n-D mask C„[?7] 
to V direction, v ^T' = {0, 1}"\0, is given by U{ui ■ ly) for 
bj E T", which is essentially a 1-D mask. Hence, as in the 
1-D wavelet construction (cf. (|5]l), one can attempt to define 
the multivariate wavelet masks t^,, E T', (note that we have 
2" — 1 wavelet masks) of the form 

t^{uj) = e-'^^-^Uiu-iy + TT), uj E T". (13) 

The next theorem shows that the above approach leads to the 
construction of n-D biorthogonal wavelet systems. 

Theorem 2: Suppose that S and U are 1-D biorthogonal 
refinement masks, and that U is interpolatory. Define n-D 
biorthogonal refinement masks as 

r:=C„[^], r<i:=C„[f/], 
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(b) 


Wavelet filter associated with the mask to,i(ti^i 
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(c) Wavelet filter associated with the mask ti^i (oji , 1^2) 



Fig. 7. Coset sum wavelet filters of Example 5 for 2-D with 4 vanishing 
moments (n = k = 2). 

and n-D wavelet masks t^, v E V, as in ( fT3] l. Then there 
exist dual wavelet masks f^, v E V, such that (r, {t,y)^^r') 
and (r'*, (t^)j/er') are n-D combined biorthogonal masks. ■ 

Proof: See Appendix IB] ■ 

Remark. We refer to the biorthogonal wavelet system con- 
structed from the n-D combined biorthogonal masks in The- 
orem |2] as the coset sum wavelet system. ■ 

Example 5: A family of n-D coset sum wavelet systems. 

We choose the univariate refinement masks U2k (interpolatory) 
and 5*2^ as in (|9]l and ( fTOl i. respectively, and apply Theorem|2] 
Then with the wavelet masks given as 

Uiu) = e-'"-"- sin2'=(i^^)Pfc(cos2(^^)), ,y E V , 

with r' = {0, 1}"\0, there exist dual wavelet masks f^, v E 
r', such that {CrXS-2.k\,itv)v&') and {CrSU2k\{^t)v<^v') are 
n-D combined biorthogonal masks. It is easy to see that all the 
wavelet masks have 2fc vanishing moments. All the wavelet 
filters are supported on the union of 2" — 1 line segments 



along V direction for v E V . For example, if n = 2, then 
r' = {(1,0),(0,1),(1,1)} and the wavelet masks for the case 
k = 2 are given as 

t(i,o)K,u;2) = e-''^^ sin4(^|) (l + 2cos2(^)) , 
Vi)K,^2) = e--^ sin4(^|) (l + 2cos2(^)) , 
t(M)(-i,-2)^e-(-+-)sin^(^;^) 

• ( 1 + 2COS ( ) 1 . 

The associated wavelet filters are depicted in Figure |7] ■ 

B. Fast coset sum wavelet algorithms 

Next we show that the coset sum wavelet system can be 
implemented by the fast algorithm with linear complexity 
whose complexity constant does not grow with the spatial 
dimension. 

Fast Coset Sum Wavelet Algorithms. Let S and U be 

biorthogonal univariate refinement masks, where U is inter- 
polatory. For the sake of simplicity, we assume that S and U 
satisfy S{~-) = S and U{—) = U. Let G and H be the filters 
associated with the refinement masks S and U, respectively. 

input yj : Z" -> R 

(1) Decomposition Algorithm: 

aG = -2" + 2+(2"-l)G(0) 
for j = J, J - 1, • • • , 1 

for k E Z" 

yj-i(fc) 

^-{aGy,{2k)+J2 E G(L)y,(2fc + Li.)) (i) 

end 

for 1/ e r' and k E Z" 
w^j-i(fc) 

= -{yj{2k+iy)-Y, H{m)y^{2k+{1-Tnyj) (ii) 

m=l 

end 

for /fc G Z" 

Aj-iik)^yji2k)-y,^i{k) 
end 
end 

(2) Reconstruction Algorithm: 

for j I,---, J - 1, J 

for fc e Z" 

yj{2k) = Aj^i{k)+yj^i{k) (iii) 
end 

for e r and k E Z" 
yj{2k + v) 

= 2w^j_i(fc) + E H{m)yj{2k + (1 - m)v) (iv) 

m=l 

end 
end 

Given coarse coefficients y^ at level j. Decomposition 
Algorithm first computes the lower level coarse coefficients 
yj-i- It then computes the wavelet coefficients w^j^i, v E 
V = {0, 1}"\0, and auxiliary coefficients Aj^i. The auxiliary 
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coefficients Aj^i do not appear in the usual wavelet decom- 
position algorithm. They are computed here in order to make 
Reconstruction Algorithm faster (cf. Complexity discussion 
below). In Step ( ii ) and ( iv) , m = 1 is used to mean that 
in is congruent to 1 in modulo 2, i.e., m is an odd integer 
Reconstruction Algorithm recovers j/j from yj-i, w^j^i, 

V £T' , and Aj-i. It first recovers yj at even points (cf. Step 
(iii)) and then at all other points (cf. Step (iv)). Step 
(iii) is possible since we stored the auxiliary coefficients 
Aj^i in Decomposition Algorithm. Step (iv) is possible 
since the only yj values we need at this step are the values at 
even points, and these are akeady computed in Step (iii) . 

Complexity. We measure complexity by counting the number 
of operations needed in order to fully derive yj-i, w^j^i, 

V G r', and Aj^i from yj, and add the number of oper- 
ations needed for the reconstruction. Here, we count only 
multiplicative operations such as multiplication and division, 
as counting additive operations gives a similar result. Thus, 
for example, computing one entry in Step (i) requires 
(2" — l)(a — 1) + 1 + n operations, where a is the number 
of nonzero entries of the filter G. 

As in the fast tensor product wavelet algorithms discussed 
in §II-Bi the complexity here is linear, i.e. ^ CN, with N 
the number of nonzero entries in yj, and C some constant 
independent of yj. We refer to this constant as the constant 
in the complexity bound or simply as the complexity constant 
throughout this paper. 

We now estimate the complexity constant for fast coset 
sum wavelet algorithms by computing the mean number of 
operations per single entry in yj. We observe that the cost 
per entry of performing one complete cycle of decomposi- 
tion/reconstruction is bounded by 

^ (2n - 1) + ((2" - l)(a - 1) + 1 + n) + 2(2" - l)^ 

< a + 2/3 + 1, 

where (3 is the number of nonzero entries of the filter H. 
Therefore, the algorithm has complexity (a+2/3+l)A^, and the 
complexity constant in this case is a + 2/3 + 1, which does not 
increase as the spatial dimension n increases. This is contrary 
to the tensor product case where the constant grows with 
the dimension (cf. i lll-BI) . There are a couple of components 
that make the coset sum wavelet algorithm this fast. First, 
as we discussed earlier (cf. (fTSTl). the wavelet masks of the 
coset sum wavelet system are essentially univariate. Second, 
the reconstruction step can be done by completely bypassing 
the dual wavelet filters. This is reminiscent of the Laplacian 
pyramid f32l, which has a trivial reconstruction algorithm 
(cf. Appendix |B]l. Here, it is essential to make the auxiliary 
coefficients Aj^i available in Reconstruction Algorithm by 
storing them in Decomposition Algorithm. ■ 
Below we compare the fast tensor product wavelet al- 
gorithms with the fast coset sum wavelet algorithms, both 
obtained from the Deslauriers-Dubuc mask and its dual mask 

in gnu] 

Example 6: Fast tensor product wavelet algorithms vs. fast 
coset sum wavelet algorithms. In this example, we compare 



the algorithms for two different families of n-D wavelet sys- 
tems constructed from the same univariate refinement masks 
by using different liftable methods: (I) the tensor product and 
(II) the coset sum. We consider the same univariate refinement 
masks as in Example 4 and 5, i.e. U2k (interpolatory) and 
S2k as in (|9]l and ( fTOl i. respectively. It is easy to see that the 
number of nonzero entries of the filter associated with S2k is 
a = 8A: — 3, and the number of nonzero entries of the filter 
associated with U2k is /3 = 2fc + 1. 

Then complexity constant for each algorithm is given as 
follows: 

(I) (Tensor Product Case) From §II-BI the complexity con- 
stant for the fast tensor product algorithm is (a + /3)ri = 
(lO/c — 2)n, which grows with the dimension. 
(II) (Coset Sum Case) From the above Complexity discus- 
sion, the complexity constant for the fast coset sum 
wavelet algorithm is a+2/3+1 = 8A:-3+2(2fc+l) + l = 
12A:, which does not grow with the dimension. 
Therefore if we fix k (hence the number of vanishing moments 
of the wavelet system) and increase the dimension n, then the 
complexity constant stays the same for the coset sum case, 
whereas it increases for the tensor product case. ■ 

V. Summary and outlook 

In this paper we presented the coset sum as an alternative 
method to the tensor product in constructing decomposable 
multivariate refinement masks. The decomposable refinement 
mask constructed by coset sum can be written as the sum, 
instead of the product, of the univariate refinement masks. 
We showed that the coset sum can provide many important 
features of the tensor product, such as preserving the biorthog- 
onality of the univariate refinement masks and the availability 
of a wavelet system with fast algorithms. 

Since the coset sum provides a way to obtain a pair of 
biorthogonal multivariate refinement masks, it can be com- 
bined with any method for finding wavelet masks to construct a 
(MRA-based biorthogonal) multivariate wavelet system. There 
has been little progress in a systematic construction of non- 
tensor based multivariate wavelet systems. The coset sum 
opens a new opportunity to this end. 

The fast tensor product wavelet algorithm has linear com- 
plexity, but the constant in the complexity bound increases 
as the spatial dimension increases. On the other hand, the 
constant in the (linear) complexity bound for the fast coset 
sum wavelet algorithm is independent of the dimension. Thus, 
when the spatial dimension is high, the coset sum wavelet 
algorithm can be faster than the tensor product wavelet algo- 
rithm. 

Coset sum is not necessarily the only alternative to the 
tensor product. Rather, its existence with desirable features 
suggests that it may be worthwhile to develop and practice 
alternative methods to the tensor product for constructing 
multivariate wavelet systems. 

Appendix 

A. Proof of Theorem [7] 

1) Proof of part (a): Suppose H and h are the filters 
associated with masks R and C„ [B\ . If i? is interpolatory, by 
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©, H{0) = 1, and at all other even points H{K) = 0. Then 
h{0) = 2" - (2" - 1)(2 - H{0)) = 1 and h{k) = = 

if Kv for some G 2Z\0, G T'. Thus /i(0) = 1 and 
/i(A:) = if fc e 2Z"\0, i.e., C„[i?] is also interpolatory. 

2) Proof of part (b): Without loss of generality, we may 
assume R is interpolatory. We want to show that, C„[i?] 
and C„[i?] are biorthogonal if and only if R and R are 
biorthogonal. 

Let i?° := {R- R{- + tt))/2 and {R + R{- + tt))/2 

be the odd and even parts of R, respectively, and let R° be 
the odd part of R. Since R is interpolatory, the even part of 
R is the constant 1/2. It is easy to check Voji e T 

W{^)r°{lo,) = 1 - iiFR) 

R and 7? are biorthogonal. 

Here, as before, the overline is used to denote the complex 
conjugate. 

We will also need the following identities: 



7e7rr 



2", 
0, 



if = 0, 
if V e T'. 



(14) 



Then from the definition of the coset sum (cf. Definition [T] (|6]l 
and O), biorthogonal condition ([U, and the above identities 
(fl4] i. we have 

Cn [R] and C„ [R] are biorthogonal 

^ ^ (C;jl]C„[i?])(L. + 7) = 1, Vc^ e T" 



7e7rr 
1 



E -2"-' + E^((^+7)-^) 



7e7rr 



-2"-i ^ R^{uj-v) 



e-'^-^R°{uj ■ v) 

<^=^2"-i(l-2"-i) 

i/er' 

+2" Y ^°(^ • '^)^°(^ • = (2""^)^ VcjGT" 



>R''{uji)R°{uji) 



1 



Therefore, C„ [i?] and C„ [i?] are biorthogonal if and only if R 
and R are biorthogonal. 

5j Proof of part (c): Let i? be a univariate interpolatory 
refinement mask with accuracy number m. First let us prove 
the accuracy number of Cn[R] is at least m. Since R has 
accuracy number m, 

{D''R){tt) = 0, VO < fc < m-1, and (i:i™i?)(7r) 7^ 0. (15) 

Furthermore, since R is interpolatory, 1 — = + tt) 
holds for all a; e T. Hence {D^{1 - R)){0) = {D^R){ti) for 



all fc G No := N U {0}. Thus 1 — R has a zero of order m at 
the origin, i.e. 



i?(0) = l 
(i?*^i?)(0)=0, Vl<fc<m-1 
(^"i?) (0)7^0. 



(16) 



Now consider the n-D refinement mask C„ [R] . The accuracy 
number of C„[i?] is at least one, i.e. C„[i?](7) = 0, for all 
7 e ttF'. To see this, we need the dual identities of (fT4l l: 



E' 



_ ^ 2", if 7 = 0, 
0, if 7 e ttF'. 



From ( [TtI i. we can read off 

#{1/ e r' : 7 - 1/ = 7r(mod27rZ)} = 2"-\ 



(17) 



(18) 



for all 7 e ttF'. In particular, the left-hand side of (fTsT l is 
independent of 7. We then have for any 7 G vrF' 

2"-iC„[i?](7) = -2"-i+^i?(7-i^) 

=i-2"-i+ R{i-^)+ E ^(^•'^) 

{ueV ■.^■u=0} {veV ■.■y-u=TT} 

where = in the second line is used to denote congruence 
in modulo 27rZ, and the last equality is from the conditions 
i?(0) = 1, R{tt) = and the identity ([TSll. Furthermore, for 
all 7 G ttF' and for all e with 1 < |m| < m - 1 
(|/i| := /ii H h A^n) 

(i?^C„[i?])(7) - ^ E (^"[^('^ ■ ^)])l"=7 

= ^E (fl<M(^'^'^)(7-)-0' 

where the last equality is from the identities (fTsT i and ( fTSI l. 
Therefore the accuracy number of C„ [R] is at least m. 

Next we prove the accuracy number of C„ [i?] is exactly m 
by contradiction. Suppose the accuracy number of C„[i?] is 
m + Z with I > 1. Then 

(i^'^C„[i?])(7)=0, 
V7 e ttF' and Vfi e NJf with < < m + ? - 1. 

Since the univariate interpolatory R and the multivariate 
interpolatory Cn[R] are connected as follows: 

=C„[i?](w,0,---,0), VcjgT, 

we have {D^R){tt) = i:>(''''0, -,o)(-^[^](^^ . . . ^ q) ^ g for 
alio < k < m + I — 1. Hence the accuracy number of R 
is at least m + /, which contradicts to the given assumption. 
Therefore the accuracy number of C„ [R] has to be rn. 
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B. Proof of Theorem |2] 

In this subsection we prove Theorem|2l In the proof we use 
the concepts of Compression- Alignment-Prediction (CAP) and 
Compression- Alignment-Modified-Prediction (CAMP) ||33l . 
CAMP is a variant of CAP, and CAP is a generalization of the 
Laplacian pyramid |32|. In particular, CAP without alignment 
operator is the same as Laplacian pyramid. It is well known 
that Laplacian pyramid has a trivial reconstruction algorithm of 
reversing the steps in its decomposition algorithm. Both CAP 
and CAMP are originally designed for the redundant wavelet 
construction, and CAMP is introduced in order to achieve a 
better space localization than CAP. 

Given r := Cn [S'], r'^ := C„[[/] with interpolatory U, and 
t^{Lo) ■= e-"'-'^U{uj -ly + ir), oj € T", i/ e F, we want 
to show that there exist dual wavelet masks tf,{uj) such that 
(t, (ty)yer') and (r'^, {tf,)^(zr') satisfy the MUEP conditions 
in ©. 

To show this, first let us construct another pair of wavelet 
masks (Ty),yer and dual wavelet masks {r^jiyer, which we 
know for sure satisfy the MUEP conditions with t and t"^. 

First extend the definition of t^, by defining to'- 



if J/ = 0, 

Then from [33 1 we know that 

= 2t-i -t^^^^^^CLj), i^GT, (19) 

where t^^*^^ is the CAMPlet mask in Section 2.3 of ll33l . 

Furthermore by comparing the CAPlet masks in Lemma 2.2 
of 1331 with the CAMPlet masks, it is easy to see that they 
are related as 

0, if 1/ = 0, 



CAP 



{uj)-t 



CAMP 



\fve V, 

(20) 

where f^{uj) = e'"'-'^ Y^-^e^r ^'"""^'^'^i^ + l)- Here it is 
necessary to point out that fy is 7r-periodic, i.e. + 7) = 
fv{<jj), for any 7 e ttF. 
Now define {ti,)i,^t 



-l^CAP 



(21) 



Then since CAP without alignment operator is the same 
as Laplacian pyramid, and Laplacian pyramid has a trivial 
reconstruction, we know that with 



if = 0, 
if e F', 



(r, (Tj,)ygr) and (r"^, (T^),yer) satisfy the MUEP conditions. 

Next, we start from the MUEP conditions of (r, (ri/)ygr) 
and (r'^, (T^)jyer) to find our dual wavelet masks f^. To do 
that, we need three more identities. The first one is a simple 
observation that can be obtained from ( fT9] l, ( |20l l and (1211 1: 



JO, ifv^Q, 



(22) 



The second one can be derived from the interpolatory property 
of and the identities ( [TtI i: 

tI{^) + ^ TMrt{^) = ^T^iuj). (23) 
i/er' 



After defining g,{uj) e"*^ " ^^^^p e-*^-^T(Lj + 7), the 
third identity: 



(24) 



i/er' 



can be shown from the biorthogonality between t and r'^ and 
the identities (T71 . Finally from the above identities 
and (|24ll, with 



1, if 7 = 0, 
0, if 7 G ttF', 



we get 



370 



i/er' 



=t{lu + j)t'^{lu) +to{Lu + 7)ro''(a;) 
+ J2 /^('^ + l)toi^ + 7) + UiuJ + 7)t^(w) 



=r(a; + 7)T'*(a;) 
+ ^io(t^ + 7) + 2"" Y t.{^ + l)gA^ + 7)^ 2t'^(w) 
-2-" ^ + 7)5,(0. + 7)2t'1(c^) 
+ E ^-(^ + 7K^H 

+ E i.(^ + 7K^H 



i/er' 



+ E O^^+t) (-2i-VHr^H + T,^M) ■ 

Therefore, by letting := — 2^^"gi^r'^ + r^, we find the 
dual wavelet masks f^, v e F', such that (r, (ti/)yer') and 
(r'^, (t^),yer') satisfy the MUEP conditions. 
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